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Universality is one of the most important ideas in computability theory. There are various criteria of 
simplicity for universal Turing machines. Probably the most popular one is to count the number of 
states/symbols. This criterion is more complex than it may appear at a first glance. In this note we 
review recent results in Algorithmic Information Theory and propose three new criteria of simplicity 
for universal prefix-free Turing machines. These criteria refer to the possibility of proving various 
natural properties of such a machine (its universality, for example) in a formal theory, PA or ZFC. In 
all cases some, but not all, machines are simple. 

1 The smallest universal Turing machine 

Roughly speaking, a universal Turing machine is a Turing machine capable of simulating any other 
Turing machine. In Turing's words: 

It can be shown that a single special machine of that type can be made to do the work of all. 
It could in fact be made to work as a model of any other machine. The special machine may 
be called the universal machine. 

The first universal Turing machine was constructed by Turing ||26l |27l . Shannon ||2"3l studied the 
problem of finding the smallest possible universal Turing machine and showed that two symbols were 
sufficient, if enough states can be used. He also proved that "it is possible to exchange symbols for states 
and vice versa (within certain limits) without much change in the product." Notable universal Turing 
machines include the machines constructed by Minsky (7-state 4-symbol) JT51, Rogozhin (4-state 6- 
symbol) 11221 . Neary-Woods (5-state 5-symbol) flTl . Herken's book ifTTI celebrates the first 50 years of 
universality. 

Weak forms of universality were proved by Watanabe (4-state 5-symbol) Ir28l . Cook (9[ for Wol- 
fram's 2-state 5-symbol machine 11291 , Neary-Woods |fT6ll , and Smith G4l for Wolfram's 2-state 3- 
symbol machine^ 

2 Universal prefix-free Turing machines 

A prefix-free Turing machine, shortly, machine, is a Turing machine whose domain is a prefix-free set. 
In what follows we will be concerned only with machines working on the binary alphabet {0, 1}. A 
universal machine U is a machine such that for every other machine C there exists a constant c (which 
depends upon U and C) such that for every program x there exists a program x' with \x'\ < \x\+c such 

'The critique by Pratt 120112 1 1 . the response in 1191 and the forthcoming paper by Margenstern 1141 show the subtlety of the 
notion of universality. 
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that U{x') = C{x). Universal machines can be effectively constructed. For example, given a computable 
enumeration of all machines (C/),-, the machine U defined by U (O'lx) = Q(x) is universal!! The domains 
of universal machines have interesting computational and coding properties, cf. (Tim. 

3 Peano arithmetic and Zermelo-Fraenkel set theory 

By J^a we denote the first-order language of arithmetic whose non-logical symbols consist of the constant 
symbols and 1, the binary relation symbol < and two binary function symbols + (addition) and • 
(multiplication). Peano arithmetic, PA, is the first-order theory |[T2ll given by a set of 15 axioms defining 
discretely ordered rings, together with induction axioms for each formula (p(x,y i, ... ,y n ) in «2a: 

Vy(<p(0 ,y) A Vx(<p(xj) -» <p(x + I,?)) -> Vx(<p(xj)). 

By PA h 6 we mean "there is a proof in PA for 6". 

PA is a first-order theory of arithmetic powerful enough to prove many important results in com- 
putability and complexity theories. For example, there are total computable functions for which PA 
cannot prove their totality, but PA can prove the totality of every primitive recursive function (and also 
of Ackermann total computable, non-primitive recursive function), see lfl2l . 

Zermelo-Fraenkel set theory with the axiom of choice, ZFC, is the standard one-sorted first-order 
theory of sets; it is considered the most common foundation of mathematics. In ZFC set membership is 
a primitive relation. By ZFC h 6 we mean "there is a proof in ZFC for 6". 

Our metatheory is ZFC. We fix a (relative) interpretation of PA in ZFC according to which each 
formula of J^a has a translation into a formula of ZFC. By abuse of language we shall use the phrase 
"sentence of arithmetic" to mean a sentence (a formula with no free variables) of ZFC that is the transla- 
tion of some formula of PA. 

4 Rudiments of Algorithmic Information Theory 

The set of bit strings is denoted by £*. If s is a bit string then |s| denotes the length of s. All reals 
will be in the unit interval. A computably enumerable (shortly, c.e.) real number a is given by an 
increasing computable sequence of rationals converging to a. Equivalently, a c.e. real a is the limit of 
an increasing primitive recursive sequence of rationals. We will blur the distinction between the real a 
and the infinite base-two expansion of a, i.e. the infinite bit sequence a\a2 • • • ot„ ■ ■ ■ (a n € {0, 1}) such 
that a = O.Gti (#2 •• By a(n) we denote the string of length n, a\ (X2 • ■ ■ cc n . 

One of the major problems in algorithmic information theory is to define and study (algorithmically) 
random reals. To this aim one can use the prefix-complexity or constructive measure theory; remarkably, 
the class of "random reals" obtained with different approaches remains the same. 

In what follows we will adopt the complexity-theoretic approach. Fix a universal machine U. The 
prefix-complexity induced by U is the function Hjj : £* — > N (N is the set of natural numbers) defined 
by the formula: Hjj(x) = min{|p| : U(p) = x}. One can prove that this complexity is optimal up to an 
additive constant in the class of all prefix-complexities {H c : C is a machine}. 

A c.e. real a is Chaitin-random if there exists a constant c such that for all n > 1, Hu{a{n)) >n — c. 
The above definition is invariant with respect to U. Every Chaitin-random real is non-computable, but 

2 See more in Q]. The above universal machine, called prefix-universal because universality is obtained by adjunction, is 
quite particular. There are universal machines which are not prefix-universal. 
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the converse is not true. Chaitin-random reals abound: they have (constructive) Lebesgue measure one, 

cf. (D. 

The standard example of c.e. Chaitin-random real is the halting probability of a universal machine 
[/(Chaitin's Omega number)H 

U{x)<°o 

Each Omega number encodes information about halting programs in the most compact way. For 
example, the answers to the following 2" +1 — 1 questions "Does U (x) halt?", for all programs \x\ < n, is 
encoded in the first n digits of Cly — an exponential rate of compression. Is this important? For example, 
to solve the Riemann hypothesis one needs to calculate the first 7,780 bits of a natural Omega number 
0- 

The following result characterises the class of c.e. Chaitin-random reals: 

Theorem 1 BEHUQC?] The set of c.e. Chaitin-random reals coincides with the set of all halting probabil- 
ities of all universal machines. 

C.e. random reals have been intensively studied in recent years, with many results summarised in 

CD EES [HQ. 

5 Universal machines simple for PA 

We start with the simple question: Can PA certify the universality of a universal machine? 

A universal machine U is called simple for PA if PA h "U is universal", i.e. PA can prove that a 
universal U, given by its full description, is indeed universal. For illustration, the results in this section 
will include full proofs. 

As one might expect, there exist universal machines simple for PA: 

Theorem 2 |31 One can effectively construct a universal machine which is simple for PA. 

Proof. The set of all machines PA can prove to be prefix-free is c.e., so if (Q); is a computable enumera- 
tion of provably prefix-free machines, then the machine Uq defined by J7o(0'lx) = C,-(jc) has the property 
specified in the theorem: PA h "£/o is universal". □ 

However, not all universal machines are simple: 

Theorem 3 One can effectively construct a universal machine which is not simple for PA. 

Proof. Let (/,),• be a c.e. enumeration of all primitive recursive functions f ■■: N — > £* and (Q); a c.e. enu- 
meration of all prefix-free machines. Fix a universal prefix-free machine U and consider the computable 
function g : N —* N defined by: 

c .( x ) = { U ^ ifforsomej>0 ) #{/;(l),i;(2) ) ...,/ i (j)}> W, 
8W*> ^ \ °°, otherwise. 

For every i, C g ^ is a prefix-free universal machine iff /j(N) is infinite (if /,(N) is finite, then so is 
Cg(;)). Since the set of all indices of primitive recursive functions with infinite range is not c.e. it follows 
that PA cannot prove that for some i, C g t^ is universal. □ 

Both results above are true for plain universal machines too. The above proofs work for plain uni- 
versal machines, but a simpler proof can be given for the negative result. 

3 t/(x) < oo means "V is defined on x". 
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6 Universal machines simple for ZFC 

Assume that the binary expansion of is O.(0i (O2 • • •■ For each digit a); we can consider two arithmetic 
sentences in ZFC, "ft), = 0", "ft), = 1". How many sentences of the above type can ZFC prove? 

Theorem 4 (8J Assume that ZFC w arithmetically sound (that is, each sentence of arithmetic proved by 
ZFC is true). Then, for every universal machine U, ZFC can determine the value of only finitely many 
bits of the binary expansion of Q-u, and one can calculate a bound on the number of bits of Q.u which 
ZFC can determines 



Actually, we can precisely describe the"moment" ZFC fails to prove any bit of 
Theorem 5 (2J Assume that ZFC is arithmetically sound. Let i > 1 and consider the c.e. random real 



Then, we can effectively construct a universal machine U ( depending upon ZFC and a ) such that PA 
proves the universality ofU, ZFC can determine at most i initial bits ofQ.\j and (X = £2j/. 

In other words, the moment the first appears (and this is always the case because a is random) ZFC 
cannot prove anything about the values of the remaining bits. 

By taking a < 1/2 we get Solovay's most "opaque" universal machine^ 

Theorem 6 11251 One can effectively construct a universal machine U such that ZFC ( if arithmetically 
sound) cannot determine any bit ofCLu. 

We say that a universal machine is n-simple for ZFC if ZFC can prove at most n digits of the binary 
expansion of Q.y. In view of Theorem [51 for every n > 1 there exists a universal machine which is 
n-simple for ZFC. By Theorem [6] there exists a universal machine which is not 1-simple for ZFC. 

7 Universal machines PA-simple for randomness 

We first express Chaitin randomness in PA. A c.e. real a is provably Chaitin-random if there exists a 
universal machine simple for PA and a constant c such that PA h "Vn(Hu(a(n)) >n — c)". 

In this context it is natural to ask the question: Which universal machines U "reveal" to PA that Qj/ 
is Chaitin-random? 

Theorem 7 ||U The halting probability of a universal machine simple for PA is provably Chaitin-random. 
In fact, Theorem[T]can be proved in PA: 

Theorem 8 (U The set of c.e. provably Chaitin-random reals coincides with the set of all halting prob- 
abilities of all universal machines simple for PA. 

Based on Theorem[7]we define another (seemingly more general) notion of randomness in PA. A c.e. 
real is provably-random (in PA) if there is a universal machine simple for PA and PA h "Cly = a". 



4 This means that ZFC can prove only finitely many sentences of the form "fflj = 0", "(0/ = 1" and one can calculate a natural 
N such that no sentence of the above type with ( > N can be proved in ZFC. 
5 Theorem[6]was obtained before Theorem[5] 



a = O.ai . . . a,_i a,a i+ i . . . , where a\ 



a,-_i = 1,0* = 0. 
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Theorem 9 flSJ A c.e. real is prov ably -random iff it is provably Chaitin-random. 

In contrast with the case of finite random strings where ZFC (hence PA) cannot prove the randomness 
of more than finitely many strings, for c.e. reals we have: 

Theorem 10 0) Every c.e. random real is provably -random. 

We say that a universal machine U is PA-simple for randomness if PA h "£2(/ is random." In view of 
the Theorem [lOl we get: 

Corollary 11 For every c.e. random real a there exists a PA-simple for randomness universal machine 
Uo such that a = Clu . 

However, 

Theorem 12 There exists a universal machine which is not PA-simple for randomness. 

8 Conclusions 

We have used some recent results in Algorithmic Information Theory to introduce three new criteria of 
simplicity for universal machines based on their "openness" in revealing information to a formal system, 
PA or ZFC. The type of encoding is essential for these criteria. This point of view might be useful in 
other contexts, specifically in automatic theorem proving. It would be interesting to "actually construct" 
the universal machines discussed in this paper. 
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